Papers with text clustering
More Discriminative Sentence Embeddings via Semantic Graph Smoothing (2024.eacl-short)
Copied to clipboard
| Challenge: | Text categorization is a natural language processing task that involves arranging texts into coherent groups based on their content. |
| Approach: | They propose to use semantic graph smoothing to enhance sentence embeddings from pretrained models to improve results for supervised and unsupervised document categorization tasks. |
| Outcome: | The proposed method improves sentences embeddings for supervised and unsupervised document categorization tasks. |
Neural Topic Modeling with Bidirectional Adversarial Training (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that neural topic models for automatic topic extraction avoid complicated mathematical derivations for model inference. |
| Approach: | They propose a bidirectional adversarial topic model which uses a generator and an encoder to infer topic distribution. |
| Outcome: | The proposed model outperforms baselines and competitive models in three benchmark corpora. |
AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models (2023.findings-eacl)
Copied to clipboard
| Challenge: | Pretrained language models often need to specialize to specific domains. |
| Approach: | They propose an approach that performs weight-space averaging of adapters trained on different domains. |
| Outcome: | The proposed approach improves performance to new domains without extra training. |
Improving Deep Embedded Clustering via Learning Cluster-level Representations (2022.coling-1)
Copied to clipboard
| Challenge: | Existing efforts to learn meaningful representations at the instance level are limited. |
| Approach: | They propose a deep embedded clustering model with cluster-level representation learning to jointly learn cluster and instance level representations. |
| Outcome: | The proposed model produces meaningful clusters on real-world short text datasets. |
Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text clustering use static pseudo-oracles, i.e., unidirectionally querying them for similarity assessment or data augmentation. |
| Approach: | They propose a training framework that enables bidirectional refinement between LLMs and embedding models by using task-aware prompts to guide the LLM in generating interpretations for the input texts. |
| Outcome: | Experiments on 14 benchmark datasets across 5 tasks demonstrate the effectiveness of the proposed training framework. |
Unsupervised Fine-tuning for Text Clustering (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to text clustering fine-tune pre-trained models have been limited. |
| Approach: | They propose a method to fine-tune pre-trained models unsupervisedly for text clustering by learning text representations and cluster assignments using a clustering oriented loss. |
| Outcome: | The proposed model outperforms baseline methods and achieves state-of-the-art results on three text clustering datasets. |